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Multi-Agency  Context 

H  den  M  itchard  and  Simon  Ng 

(D  efaice  Science  and  T  echnology  0  rganisation,  A  US) 


Abstract 

There  is  a  need  to  integrate  a  range  of  stakeholders,  both  military  and 
non-military,  into  the  planning  and  conduct  of  operations,  both  civil  and 
military.  These  endeavors  necessitate  the  inclusion  of  many  stakehold¬ 
ers,  each  of  which  bring  diverse  agendas,  values,  and  differing  degrees  of 
experience  and  training.  Anecdotes  suggest  that  techniques  used  to  inform 
planning  and  subsequent  operations  often  fail  to  reflect  the  complexity  of 
such  multi-agency  environments.  We  report  on  a  technique  that  has  been 
used  successfully  to  explore  the  issues  evident  in  multi-agency  planning 
and  operations  Specifically,  we  report  on  the  use  and  suitability  of  Engle 
matrix  gaming  methods  to  simulate  the  complex  nature  of  the  problem 
space.  T  he  key  to  success  of  these  activities  is  related  to  the  level  of  prepa¬ 
ration  and  we  discuss  what  issues  should  be  considered  with  regard  to  the 
scenario,  personnel  and  overall  planning. 

I n  memory  of  Dr.  Terry  W  ebb. 


Introduction 

The  events  of  9/ 11  and  H  urricane  K  atrina  underscore  the  need 
to  improve  interagency  coordination  between  various  bodies.  M  any 
government  departments  share  responsibilities  and  there  isa  require¬ 
ment  to  improve  the  coordination  and  response  to  these  incidents. 
U  nderstanding  and  modifying  concepts  of  operation,  technology 


2  T  he  International  C 2  Journal  |  Vol  4,  No  3 


and  systems,  and  policy  amongst  all  of  these  organizations  requires 
a  form  of  interaction  to  make  explicit,  the  implicit  and  cultural 
knowledge  contained  within  each  of  the  participants. 

Wargames  emerged  in  abstract  forms  thousands  of  years  ago,  for 
example  go  in  Asia  and  chess  in  Europe.  Their  utility  for  support¬ 
ing  military  education  has  been  appreciated  for  almost  as  long,  with 
significant  documented  use  for  this  purpose  since  the  17th  century 
(Perla  1990).  However,  for  wargames  to  successfully  support  mili¬ 
tary  planning  and  training,  they  must  incorporate  and  reflect  in  their 
designs  important  factors  at  play  in  the  world.  When  wargaming 
focuses  solely  on  the  tactical  and  operational  events  taking  place  in 
the  military  domain,  and  does  not  consider  geo-political  and  eco¬ 
nomic  factors,  the  results  can  be  misleading.  Reflect  on  the  wargam¬ 
ing  of  the  Schlieffen  plan  which  neglected  to  simulate  the  diplomatic 
and  political  consequences  of  Germany's  actions,  with  the  resul¬ 
tant  outcome  of  the  plan  upon  execution  being  utterly  unexpected 
(C  affrey  2000). 

H  ow  can  we  situate  players  within  an  environment  that  captures  this 
richness  and  that  gives  them  the  capacity  to  learn  about  the  com¬ 
plexity  of  the  socio-political  space  infusing  modern  operations?  T  he 
type  of  problem  addressed  often  suggests  the  activity  which  is  most 
likely  to  shed  some  light  on  the  problem.  H  ung  and  Van  Eck's  tax¬ 
onomy  of  game  types  (2010)  (T able  1)  includes  role  playing  games, 
the  category  in  which  Engle  matrix  games  (Engle  1990)  belong. 
Engle  matrix  games  are  designed  to  be  sufficiently  rich  to  reflect  a 
multitude  of  military,  social,  political,  and  economic  drivers  within  a 
wargaming  environment.  Some  examples  of  their  use  are  the  simu¬ 
lation  of  situations,  involving  both  war  fighting  and  peace  support, 
for  the  British  Army  since  the  mid  90’s1  and  as  part  of  the  NATO 
training  group,  teaching  languages  to  the  French  Army.2  Here,  we 
outline  their  use  and  discuss  how  this  technique  can  be,  and  has 
been,  usefully  applied  to  interagency  coordination  issues. 


1.  M  ajor  Tom  M  ouat  M  BE,  e-mail  message  to  first  author,  July  18,  2009. 

2.  Neal  Durando,  Defence  Linguistics,  e-mail  message  to  first  author,  July  17, 
2009. 
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The  Engle  matrix  game  is  a  multi-sided,  role-based  seminar  game 
with  structured  turns.  1 1  is  possible  for  a  given  roleto  win  in  the  game 
(by  achieving  its  objectives)  without  other  roles  losing.  Each  player 
or  team  assumes  a  role  within  the  game  and  makes  an  argument 
during  each  turn  for  how  their  action  will  change  the  game  world. 
These  arguments  are  assessed  as  to  their  likelihood  by  the  adjudica¬ 
tor.  Subsequently  either  the  adjudicator  or  chance  is  used  to  decide 
the  outcome  of  the  arguments,  with  the  results  of  the  arguments  and 
the  nature  of  the  pre-existing  conditions  from  earlier  in  the  game 
shaping  the  likelihood  of  success.  T  he  outcomes  become  facts  in  the 
game  world.  T  hesame  process  is  followed  for  counter  arguments  As 
each  turn  passes,  the  facts  accumulate  to  build  a  new  world. 

Engle  matrix  games  are  a  form  of  structured  experiential  learn¬ 
ing—  resulting  in  a  strong  exchange  of  tacit  and  explicit  knowledge 
between  participants  With  some  modification,  Engle  matrix  games 
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are  capable  of  making  implicit  knowledge  explicit,  both  through 
verbalization  and  recorded  data.  Surfacing  assumptions  is  a  strength 
of  Engle  matrix  games  and  a  distinct  advantage  when  considering 
interagency  issues. 

We  repeat  the  lessons  we  have  learned  about  execution  of  an  E  ngle 
matrix  game.  Where  possible,  the  validity  of  particular  approaches 
is  discussed  with  reference  to  research  literature.  T  he  first  part  of  the 
article  introduces  the  components  of  an  Engle  matrix  game.  Part 
two  discusses  the  game  itself,  its  design  and  execution.  The  third 
part  discusses  analysis  and  presents  an  example.  Finally,  the  article 
highlights  potential  future  directions  for  development  and  employ¬ 
ment  of  the  technique. 


Components 

In  this  section,  we  outline  some  of  the  issues  that  need  to  be  con¬ 
sidered  when  creating  an  Engle  matrix  game.  The  first  item  is  to 
determine  the  purpose  of  the  game.  Isthegoal  to  provide  a  learning 
experience  for  the  participants,  to  explore  the  situation  for  possible 
responses  or  to  analyze  the  implications?  Having  determined  the 
goal  of  the  game,  a  plan  can  be  constructed  covering  the  scenario, 
roles,  the  matrix,  orientation,  the  number  of  turns  and  the  debrief¬ 
ing  session. 

Engle  matrix  gamestake  from  several  hoursto  several  daysto  execute, 
depending  on  both  the  number  of  participants  and  the  complex¬ 
ity  of  the  scenario.  T  he  length  and  complexity  of  an  E  ngle  M  atrix 
game  isclosely  linked  to  the  number  of  players;  less  than  4  roles  gen¬ 
erating  insufficiently  complex  interactions  and  greater  than  10  roles 
becoming  unmanageable.  T  he  initial  phase  covers  orientation  and  is 
the  section  in  which  participants  plan  and  establish  their  strategies. 
On  average,  orientation  takes  approximately  an  hour,  subsequent 
turns  take  approximately  20-40  minutesand  the  game  typically  lasts 
between  5  and  10  turns.  Actions  must  be  strategic  and  goal  oriented 
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and  at  least  an  hour  should  be  set  aside  for  debriefing  at  the  end  of 
the  matrix  game.  0  rientation  should  meet  the  standards  applied  to 
any  military  experimentation  activity,  but  should  include  briefing  of: 

•  T  he  structure  and  mechanisms  of  game  play;  and 

•  Time  to  read  the  documentation  of  the  goals,  constraints,  and 
resources  applicable  to  that  role. 

T  he  length  of  the  preparation  time  is  a  function  of  the  researcher's 
familiarity  with  the  area  that  the  scenario  is  set  in,  the  goals  of  the 
matrix  game  (e.g.,  experiential  or  predictive)  and,  most  importantly, 
the  complexity  of  the  issues  under  consideration  within  the  game. 
Scenario  design  in  matrix  games  is  critical  to  successful  problem 
sol  vi  ng.  T  he  scenario  provides  the  context  for  the  game.  1 1  must  bal¬ 
ance  explicit  facts  and  history  for  the  game  against  excessive  defini¬ 
tion,  which  would  unnecessarily  constrain  play.  T  he  scenario  should 
contain  comprehensive  and  accurate  information:  to  establish  what 
is  true  in  the  simulated  world,  but  not  fetter  the  playing  of  the  game. 
Preparation  of  the  scenario  can  require  considerable  effort;  for 
example,  the  Joint  Experiment  (JE)  program  spent  approximately 
8  weeks  in  preparation  for  a  1  week  matrix  game  event  (Ng  et  al. 
2006).  0  n  the  other  hand,  E  ngle  matrix  games  can  be  prepared  in 
several  hours.  T  he  definition  of  roles  must  detail: 

•  T  he  scenario  specific  goals  of  the  role:  what  are  the  players  who 
adopt  that  role  ai  mi  ng  for?  W  hat  constitutes  success  for  them? 

•  T  he  values  observed  by  the  role,  e.g.  doesthe  group  or  individual 
embodied  in  the  role  believe  in  freedom  of  speech? 

•  T  he  constraints  applicable  to  that  role. 


•  The  resources  available  to  the  role.  Resources  can  be  military 
assets,  financial  resources,  political  resources,  or  social  capital. 
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•  T  he  allowable  interactions  between  roles:  who  can  talk  to  whom 
and  how? 

•  A  history  of  these  relationships 

•  T  he  current  positions  of  each  role. 

Pre-testing  the  scenario  and  the  role  descriptions  is  advisable.  The 
written  descriptions  should  be  reviewed  by  independent  advisers 
to  ensure  they  are  understandable,  comprehensive,  and  concise. 
Emotionally  or  culturally  charged  words  may  cause  an  unintended 
biasand  it  can  be  worthwhilefor  researchers  to  prepare  descriptions 
of  the  situation  independently  and  to  then  amalgamate  these  as  part 
of  scenario  development. 

Typical  wargames  usually  consider  two  or  three  "sides"  (red,  blue, 
and  gray/ green).  The  multiple  roles  inherent  in  an  Engle  matrix 
game  can  result  in  an  increase  in  the  complexity  of  actions  and  rela¬ 
tionships  beyond  that  typically  experienced  in  wargames.  One  of 
the  arguments  against  a  two  sided  game  is  the  lack  of  realism,  but 
the  many  roles  of  an  E  ngle  matrix  game  reduce  the  strength  of  that 
argument.  Engle  matrix  games  generally  have  seven  to  nine  roles 
and  each  role  can  have  up  to  three  participants  (although  both  are 
arbitrary  numbers  chosen  mostly  for  manageability). 

When  selecting  participants,  research  on  expert  decision-making 
(Simon  1955;  Simon  1956;  Dreyfus  and  Dreyfus  1986;  Klein  1998) 
suggests  that  novices  are  less  able  to  see  patterns  within  a  context, 
making  their  actions  less  appropriate,  and  therefore,  less  likely  to 
reflect  actions  typical  of  the  roles  they  are  portraying  within  the 
wargame.  As  participants  draw  on  their  tacit  knowledge  and  experi¬ 
ence  to  complete  the  role  they  are  playing,  players  with  experience 
or  knowledge  relevant  to  the  scenario  are  central  to  success.  If  "pre¬ 
tend"  players  have  to  be  used,  it  should  be  kept  in  mind  that  such 
players  will  require  a  great  deal  more  background. 
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However,  the  use  of  experts  is  not  risk-free.  Research  on  learning 
generalizability  suggests  that  prior  experience  is  typically  not  called 
on  in  solving  a  new,  related  problem  unless  subjects  have  been 
explicitly  told  to  consider  the  similarities  between  the  two  or  have 
been  trained  to  identify  similarities  (G  ickand  H  olyoak  1980;  Perkins 
and  Salomon  1988;  Salomon  and  Perkins  1989).  Similarly,  if  the 
situation  or  problem  is  new,  prior  experience  may  account  for  less 
and  experts  generally  fail  to  recognize  when  their  expertise  no  lon¬ 
ger  applies  (K  lein  1998).  To  make  best  use  of  prior  experience,  the 
scenario  must  allow  participants  to  connect  that  experience  to  the 
problem  at  hand. 

An  element  in  analysis  is  attributing  the  causes  to  either  external 
(situational)  or  internal  (personal)  factors.  T  here  are  marked  differ¬ 
ences  across  cultures  and  this  can  change  the  considered  actions  of 
the  participants  Participants  draw  on  their  schemas,  e.g.  experi¬ 
ences  and  cultural  beliefs  when  playing  a  game  (Cooper  et  al.  1999; 
Heinrich  etal.  2001).  Careful  consideration  needs  to  be  given  to  the 
choice  of  participants  for  the  game  because  these  factors  can  enrich 
or  confound  an  experiment.  In  a  scenario  exploring  multi-cultural 
issues,  for  example,  it  may  be  beneficial  to  draw  participants  from 
the  cultures  depicted  in  the  scenario,  partly  to  highlight  issues  such 
as  stereotyping.  Chandler  and  Spies  (1996)  found  a  large  variation 
in  the  attributions  used  by  participants  in  games  in  seven  countries. 
Certain  behaviors,  particularly  aggression  but  also  conformity,  com¬ 
pliance  and  cooperation,  can  be  the  result  of  personal  intentions  or 
cultural  values 

We  have  focused  on  participants,  but  other  personnel  such  as  facili¬ 
tators,  adjudicators,  analysts,  and  general  assistants  are  needed.  The 
facilitator  should  be  cognizant  of  the  influence  they  can  exert  on  the 
game.  In  some  cases  this  can  be  a  desirable  thing  when  the  game  is 
designed  to  explore  a  particular  scenario  but  if  a  general  exploration 
of  the  space  is  intended  then  the  facilitator  should  limit  their  influ¬ 
ence  to  smoothing  the  progress  of  the  game.  Analysts  are  required 
to  interpret  data  either  during  or  post-  activity.  General  assistants 
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are  used  for  writing  and  displaying  arguments  and  results,  general 
ushering,  such  as  gathering  participants  for  communal  discussions, 
and  to  answer  questions. 

If  one  has  the  choice  of  where  to  run  the  game,  several  issues  need 
to  be  considered,  such  as  convenience  and  availability,  but  the  aim 
of  the  scenario  will  also  impact  on  the  choice  of  venue.  If  a  matrix 
game  is  played  in  context,  e.g.  in  a  work  area,  the  use  of  context 
may  make  subjects  more  sensitive  to  the  strategic  implications  of  the 
game.  However  such  a  context  may  only  benefit  the  participants 
whose  roles  are  carried  out  in  a  similar  work  area.  An  out  of  context 
environment,  intended  to  minimize  any  relation  to  subjects'  field 
experiences,  may  reduce  sensitivity  to  the  strategic  implications  of 
the  game  (C  ooper  et  al.  1999). 

The  matrix  is  a  list  of  actions  a  role  can  take  in  a  classical  Engle 
matrix  game.  For  interagency  experimentation  it  may  be  difficult 
to  enumerate  a  majority  of  possible  actions  so  a  matrix  may  not  be 
prepared.  Game  history  (captured  manually  or  electronically)  must 
be  available  to  the  players  0  ther  important  components  include: 

•  Turn  sheets  are  critical  if  rigorous  data  capture  is  desired.  Turn 
sheets  allow  the  participants  to  record  their  arguments,  but  also 
to  indicate  previous  facts  that  support  their  arguments,  providing 
a  means  for  traceability  from  one  phase  of  play  to  the  next. 

•  M  aps  provide  visual  context  for  the  scenario.  I  n  some  instances 
paper  based  area  movement  maps  are  adequate;  in  others,  com¬ 
putational  resolution  may  be  necessary.  In  either  case,  maps 
should  not  distract  the  participants  from  the  essential  nature  of 
the  game. 

•  I  mages,  video,  and  audio  can  be  used  to  establish  context  and  to 
improve  participants'  immersion. 
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•  Scenario  date  and  time  information  can  also  help  with  improv¬ 
ing  immersion.  Real-world  time  information  is  important  for 
regulating  play  but  needsto  be  used  sensitively  as  it  can  decrease 
the  level  of  psychological  validity 

Raser  (1969)  identifies  four  criteria  for  assessing  the  validity  of  gam¬ 
ing  as  a  research  technique:  predictive  validity,  psychological  valid¬ 
ity,  structural  validity,  and  process  validity.  These  four  criteria  apply 
equally  to  Engle  matrix  gaming  as  a  form  of  (non-computer  based) 
simulation.  The  first  type,  predictive  validity,  refers  to  the  capac¬ 
ity  of  the  simulation  to  predict  plausible  outcomes  (see  Analysis  for 
a  brief  discussion).  Psychological  validity  is  maximized  when  the 
game  seems  valid  to  the  participants  and  increases  the  possibility 
that  the  behaviors  displayed  by  the  participants  will  correspond 
to  those  found  in  real-life.  Structural  validity  is  determined  by  the 
degree  to  which  the  game's  structure  can  be  shown  to  correspond  to 
that  of  the  reference  system.  In  other  words,  isthere  reasonable  con¬ 
gruence  between  the  "elements, ...  and  the  way  they  are  connected 
are  reflected  in  the  game  model"  (Peters  1998,  24).  Process  validity 
is  similar  to  structural  validity  except  that  it  refers  to  processes,  e.g. 
i  nfo  r  m  ati  o  n  f  I  o  ws  th  at  ta  ke  p  I  ace.  T  hese  th  ree  ty  pes  of  va  I  i  d  i  ty  affect 
the  predictive  validity  and  are  maximized  in  the  careful  construction 
of  the  components  of  an  E  ngle  matrix  game. 


Game  play 

Game  play  proceeds  turn  by  turn,  with  each  role  playing  an 
action,  simultaneously,  randomly  or  in  a  pre-determined  sequence. 
Simultaneous  play  creates  the  conditions  for  ambiguity,  for  example 
the  "fog  of  war.”  It  can  promote  proactive  strategies  and  limit  reac¬ 
tive  strategies  but  can  also  result  in  disconnected  styles  of  play,  in 
which  the  actions  of  one  person  are  given  less  consideration  by  oth¬ 
ers.  Random  play  is  determined  by  the  most  recent  argument  or 
event  and  the  participant  or  team  who  is  most  affected.  T  hroughout, 
the  rules  of  the  game  are  open  to  discussion  as  to  how  they  impact 
on  the  course  of  the  game. 
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The  players'  responsibilities  are  summed  up  by  the  necessity  to  make 
one  argument  each  turn,  causing  something  to  happen  to  further 
their  objective.  I  n  a  classical  E  ngle  matrix  game,  arguments  are  clas¬ 
sified  as  one  of  three  types  (E  ngle  1995): 

•  Planning  arguments:  that  set  the  scene  for  future  actions 

•  Conflict  arguments:  that  force  a  showdown  between  two  or  more 
players  over  control  of  resources. 

•  T  rouble  arguments:  that  cause  other  players  to  experience  some 
kind  of  difficulty  that  must  be  solved. 

Each  argument  consists  of  an  argument  for  an  action,  a  result,  and 
three  supporting  reasons  for  why  the  action  should  be  successful. 
Participants  may  also  make  additional  arguments  in  response  to  the 
arguments  of  another  role,  i.e.,  counter  arguments  and  counter¬ 
counter  arguments.  Arguments  from  different  roles  may  compete 
with  one  another  because  of  logical  inconsistency  or  mutual  exclu¬ 
sivity,  requiring  adjudication  based  on  an  assessment  of  the  relative 
strengths  of  the  arguments.  Where  planning  arguments  are  made 
and  the  participant  does  not  want  other  participants  to  know  of 
their  intentions,  a  secret  argument  can  be  made.  In  the  interests  of 
having  a  reasonably  paced  game  however,  a  limit  may  be  set  on  the 
number  of  secret  arguments  allowed. 

Each  role  when  completing  their  turn  sheet  determines  their  actions, 
effects,  enablers,  and  outcomes.  T  his  in  turn  will  inform  or  construct 
their  argument.  A  classical  E  ngle  matrix  game  (E  ngle  1995)  resolves 
the  success  or  failure  of  an  argument  by  combining  the  strength  (or 
qualitative  likelihood)  of  the  argument  with  the  result  of  a  roll  of 
a  die.  H  owever  decisions  on  the  success  or  failure  of  an  argument 
can  be  the  responsibility  of  an  adjudicator  or  an  adjudication  cell. 
Whichever  is  used,  the  adjudicator  has  the  responsibility  for  decid¬ 
ing  how  strong  each  argument  is  and  who  is  in  the  strongest  position 
in  conflicts  Similar  to  the  facilitator,  the  adjudicator  should  attempt 
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to  assist  the  game  but  refrain  from  passing  judgment  on  what  they 
consider  acceptable  actions.  W  hen  using  an  E  ngle  matrix  game,  any 
deletion  of  paths  on  the  grounds  that  they  are  unlikely  (e.g.,  in  the 
adjudicator's  culture)  may  be  harmful.  T  his  is  not  to  say  that  every 
proposed  action  is  likely;  however,  the  adjudicator  must  be  careful 
to  determine  the  grounds  on  which  the  arguments  are  assessed.  T  he 
adjudicator  should  keep  careful  records  of  decisions  made  and  out¬ 
comes  for  later  reconstruction  and  investigation  of  alternate  branches 
in  the  game;  Defence  Science  and  Technology  0  rganisation'sjoint 
Decision  Support  Centre  has  developed  GdmeNet  for  capturing  such 
information. 

At  the  end  of  each  turn,  all  actions  are  decided  either  by  the  facilita¬ 
tor  using  subject  matter  experts  (SM  Es)  or  some  objective  mecha¬ 
nism.  Those  arguments  that  are  successful  are  established  as  fact 
and  define  the  game  world  thereafter.  N  o  fact  can  ever  be  reversed 
without  reversing  all  subsequent  facts  within  the  scenario  (in  effect, 
winding  back  the  scenario  clock). 

Games  lasting  several  hours  or  days  need  to  be  followed  up  with 
debriefing  of  the  game's  process.  When  participants  discuss  their 
actions  and  subsequent  effects  then  their  understanding  of  their 
own  and  others'  actions  is  enhanced.  This  process  further  enables 
the  observations  and  experiences  of  participants  to  contribute  to 
changing  their  mental  models,  demonstrating  double  loop  learning 
(Argyris  1982)  in  the  creation  of  a  new  mental  representation  (Boyd 
1976),  usually  facilitating  future  interagency  collaboration. 


Use  of  Analysis 

Engle  matrix  games  are  employed  in  several  ways:  educational  or 
operational.  As  an  educational  device  they  are  played  to  give  the 
participants  a  learning  experience.  U  sed  as  a  tool  for  exploration  or 
as  an  operational  tool  the  results  can  be  analyzed.  If  contemplating 
analysis  there  are  several  cautionary  indicators. 
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During  analysis,  awareness  must  be  maintained  of  the  (by  neces¬ 
sity)  limited  space  that  was  explored  and  the  impact  of  this  limita¬ 
tion.  In  addition,  the  socio-political  complexities  of  many  geopoliti¬ 
cal  and  military  problems  mean  that  it  is  difficult  for  an  expert  to 
take  all  influences  into  consideration  when  predicting  an  outcome. 
It  is  known  that  experts  have  difficulty  predicting  the  results  of  large 
changes  or  unusual  events  Carroll  et  al.  (1988)  found  that  expert 
deliberations  often  deviated  from  normative  logic:  experts  are  prob¬ 
ably  better  at  identifying  what  should  happen  than  what  will  happen. 
When  contemplating  multi-agency  scenarios,  it  is  very  unlikely  that 
an  expert  in  one  field  will  be  able  to  accurately  predict  the  actions  of 
people  from  other  organizations  as  the  actions  are  often  outside  the 
expert's  experience. 

Studies  suggest  that  role  playing  in  simple  scenarios  provides  almost 
twice  the  predictive  capacity  of  expert  judgment  or  the  mathemati¬ 
cal  Von  Neumann  Game  Theory  (Borman  1982;  Green  2002; 
Green  2005;  Armstrong  2000).  Indications  are  that  if  the  results 
are  congruent  then  approximately  five  sessions  are  needed  per  sce¬ 
nario,  with  divergent  results  necessitating  more  sessions  (Armstrong 
2000).  T  his  increase  does  not  indicate  the  infallibility  of  analysis  but 
E  ngle  matrix  games  should  at  least  equal  the  predictive  accuracy  of 
role  playing  games  because  of  their  multi-player  nature  and  greater 
complexity. 

The  history  of  war  game  use  suggests  there  is  agreement  among 
defense  personnel  that  wargaming  is  worthwhile  in  shedding  light 
on  questions  about  the  situation  examined.  E  ngle  matrix  games  are 
capable  of  making  implicit  knowledge  explicit,  both  through  verbal¬ 
ization  and  via  auditable,  recorded  data.  The  effort  is  useful  as  this 
is  one  of  the  strengths  of  Engle  matrix  games,  surfacing  the  assump¬ 
tions  of  the  participant,  as  often  the  questions  the  game  reveals  are 
more  important  than  the  outcomes 
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An  Illustration 

The  Defence  Science  and  Technology  Organisation  has  applied 
the  Engle  matrix  game  technique  in  a  range  of  settings,  including 
the  exploration  of  an  interagency  strategic  planning  concept  (N  g  et 
al.  2006).  This  section  describes  an  application  in  which  two  paral¬ 
lel  matrix  games  were  run  to  explore  the  consequences  of  different 
stakeholders  and  methods  on  strategic  planning. 

Preparatory  work  prior  to  the  games  detailed  the  scenario,  identi¬ 
fied  key  stakeholders,  their  goals,  values,  constraints  and  resources, 
and  the  relationships  between  the  stakeholders'  goals.  Each  game 
used  the  same  scenario  and  included  the  same  stakeholders  with 
the  exception  of  the  players  for  the  Australian  Strategic  Planning 
role  who  differed.  In  the  Whole  of  Government  Planners'  game, 
the  Australian  Strategic  Planning  stakeholder  role  was  played  by 
a  Whole  of  Government  cell  with  representatives  from  a  range  of 
key  government  departments  In  the  M  ilitary  Planners  game,  the 
Australian  Strategic  Planning  stakeholder  role  was  played  by  senior 
military  strategic  planners,  comprised  of  military  strategic  personnel 
who  planned  without  input  from  outside  defense.  Senior  SM  Eswere 
available  to  all  players  and  formed  part  of  the  adjudication  process. 

Information  (see  figures  1,  2,  and  3  for  an  example)  was  provided 
to  the  players  prior  to  the  matrix  game  and  the  appropriateness 
of  these  "tools"  was  evaluated  at  the  end  of  the  matrix  game.  T  he 
results  indicated  a  preference  for  certain  tools— Conflict  Analysis 
graphs  were  found  particularly  useful;  T  ree  D  iagramsand  I  nfluence 
D  iagrams  were  found  less  useful.  T  he  types  of  relationships  shown 
in  Figure  1  indicated  to  the  players  that  a  complete  win-win  situa¬ 
tion  was  not  feasible  within  the  scenario,  but  that  certain  positive 
outcomes  could  be  achieved,  depending  upon  decisions  made  by 
players 
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Figure  L  An  illustration  of  a  Stakeholder  Map  for  Stakeholder  Y 


Figure  2.  An  illustration  of  a  Conflict  Analysis  graph  showing  the 
degree  to  which  Stakeholder  Y's  position  or  i  ntent  is  supported  by 
Stakeholder  X's  objectives. 
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Figure3.  An  illustration  of  aTree  Diagram  indicating  potential 
leverage  points  (bottom  nodes)  that  Stakeholder  Y  may  use  to  influ¬ 
ence  Stakeholder  X's  attitude  to  a  particular  issuer 

A  sample  of  the  events  developed  during  game  play  is  contained  in 
Table  2  which  provides  some  indication  of  the  data  collected.  An 
analysis  of  the  differences  in  the  plans  produced  by  the  key  stake¬ 
holder,  the  Australian  Strategic  Planning  stakeholder,  was  made  by: 

•  Evaluating  the  topology  of  the  matrix  of  factswithin  each  game; 

•  Examining  the  qualitative  differences  in  the  style  of  play  and  the 
details  of  the  plans  formulated  during  play;  and 

•  Comparing  the  strategic  directions  of  game  play  and  how  they 
differed  between  the  two  matrix  games 
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Table  2.  Sample  results  from  game  showing  the  outcomes  of  vari¬ 
ous  actions  by  Stakeholders  X  and  Y  inturn  3of  the  matrix  game 
The  last  column  shows  captured  interrelationships  between  previ¬ 
ous  Effects  generated  during  turns  land  2  and  how  they  supported 
or  opposed  Effects  in  turn  3. 


Turn#  Outcome 

Effect 

Stakeholder 

Generating 

Effect 

Agency 

conducting 

task 

Previous  Effects 
Supporting^  Opposing 

3  Fail 

3.1  Improve 
international 
perception  of 
Stakeholder  X 
being  able  to 
deal  with 
insurgency 

X 

Government 

D  epartment  A 

2.9/ nil 

Partial 

Success 

3.2  Suppress 

Insurgency 

activities 

Y 

M  ilitary 

1.7, 1.9,2.2/21 

Success 

3.3  Improve 
economic 
circumstances 
of  stakeholder  Z 

Y 

Foreign  Aid 
Organization 

1.7/ 2.1 

Success 

3.4  1 ncrease 
regional  security 
in  area  of 
operations 

Y 

M  ilitary 

1.7,1.10/ nil 

T  he  topology  of  the  plans  was  measured  from  the  game  play  data  by: 
the  degree  of  branching  (the  ratio  of  effects  to  actions);  the  degree 
of  cross-linking  (how  many  effects  a  task  contributed  to);  and  the 
Inter  Agency  Coordination  Requirement  rating  (IACR),  a  measure 
of  the  degree  to  which  different  agencies  were  undertaking  separate 
actions  to  achieve  the  same  effects  in  the  plan. 
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M  ultiple  agencies  contributing  to  shared  effects 
through  different  tasks 


Potential  Interagency  Coordination  Requirements 


Branching 


Crosslinking 


Figure  4  Concepts  for  measuri  ng  the  topology  of  each  of  the  two 
games  based  upon  an  analysis  of  the  interrelationships  between 
effects,  actions,  and  agencies  undertaking  actions  recorded  during 
game  play. 


This  analysis  was  made  possible  by  the  audit  trail  of  actions,  effects, 
and  agencies  responsible  that  was  recorded  as  part  of  game  play 
Table  3  presents  these  different  measures  of  topology. 
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Table  3.  Topol  og  cal  measures  for  the  two  planning  teams’  plans. 
Note  that  the  Whole  of  Government  team  tended  to  assign  more 
tasks  to  achieve  a  given  effect,  but  committed  less  tasks  to  achieving 
multi  pie  effects.  Higher  IACR  values  imply  more  significant  require¬ 
ments  for  coordination  amongst  agencies. 


Whole  of  Government 

Military 

Branching 

2.2 

2.1 

Cross-linking 

L5 

1.8 

Links 

35 

23 

Effects 

16 

11 

Tasks 

24 

13 

IACR 

1.4 

1.9 

Based  on  this  analysis,  the  following  observations  were  made: 

•  The  plan  developed  by  the  Australian  Government  Planning 
Stakeholder  within  the  Whole  of  Government  game  had  a 
slightly  greater  degree  of  branching,  consistent  with  more  tasks 
contributing  to  any  given  effect; 

•  The  plan  developed  by  the  Australian  Government  Planning 
Stakeholder  within  the  Whole  of  Government  game  had  a  lower 
degree  of  cross-linking,  consistent  with  tasks  in  the  plan  aimed  at 
achieving  fewer  effects; 

•  The  strategic  plan  developed  by  the  Australian  Government 
Planning  Stakeholder  within  the  M  ilitary  game  had  a  higher 
IACR,  consistent  with  the  plan  demanding  more  coordination 
and  cooperation  in  order  to  achieve  the  desired  effects  within 
the  strategic  scenario.  This  may  indicate  that  the  M  ilitary  had 
developed  a  plan  with  greater  overheads  and  higher  risk  of  mis¬ 
alignment,  but  also  with  greater  potential  for  synergies. 
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Observed  differences  in  style  of  play  were  interesting  and  had  a 
direct  bearing  on  the  outcome  of  each  of  the  games.  I  n  particular, 
the  team  playing  the  Australian  Government  Planning  Stakeholder 
role  in  the  Whole  of  Government  game  was  more  reactive  and 
less  direct  than  the  team  in  the  M  ilitary  game,  which  gave  them 
latitude  to  adjust  as  the  game  proceeded.  This  resulted  in  a  very 
quick  divergence  in  play  between  the  two  games,  with  the  Whole  of 
Government  game  moving  into  a  strategic  space  driven  by  dialogue 
and  an  attempt  to  find  common  ground,  while  the  M  ilitary  game 
quickly  became  confrontational. 

Networksof  effects  were  documented  (seethe  last  column  in  T  able  2) 
and  recurring  effects  acted  as  tipping  points  within  each  game.  The 
outcome  of  both  games  was  heavily  contingent  upon  (a)  the  degree 
of  in-game  dialogue  established  between  key  stakeholders  within 
the  scenario,  (b)  the  degree  to  which  nationalism  amongst  certain 
stakeholders  outweighed  cooperation,  and  (c)  the  extent  to  which  the 
international  community  supported  one  stakeholder  over  another. 
These  tipping  points  were  used  to  support  other  forms  of  analysis — 
a  Field  Anomaly  Relaxation  study  and  Faustian  Tree  analysis  that 
plotted  out  alternative  developmental  paths  for  the  scenario. 

W  ithout  more  sophisticated  tools  and  methods  to  support  the  matrix 
game  process,  capturing  data  within  the  games  and  analyzing  data 
proved  time  consuming  and  prone  to  error.  Adjudication  was  dif¬ 
ficult  and  sometimes  arbitrary,  and  preventing  SM  Esfrom  seeding 
ideas  during  game  play  proved  particularly  problematic. 

T  he  possibility  of  using  the  matrix  game  to  explore  large  segments 
of  the  scenario  landscape  remains  open,  although  "winding  back" 
the  matrix  game  clock  and  exploring  alternate  paths  would  demand 
considerable  resources  and  time.  FI  owever,  the  matrix  game  itself 
might  provide  enough  data  on  key  factors  governing  the  scenario  to 
facilitate  other  approaches  to  exploring  the  potential  scenario  land¬ 
scape.  T  he  data  could,  for  example,  be  used  to  build  and  populate  a 
Bayesian  N  etwork  model.  T  he  technique  may  also  provide  a  strong 
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learning  environment,  although  no  data  with  respect  to  this  was  col¬ 
lected  as  part  of  the  program  of  work  reported  on  herein.  In  this 
study,  the  tipping  point  information,  was  especially  useful  in  gen¬ 
erating  a  series  of  follow-on  operational  level  scenarios  for  military 
operational  analysis 

The  concept  revealed  significant  issues  with  respect  to  the  funda¬ 
mental  question  of  the  impact  that  the  two  alternative  planning 
structures  had  on  the  nature  of  the  plans  developed.  T  hese  issues 
have  informed  discussion  with  th eAustrdlidn  Depdrtmentof  Defence. 


Conclusion 

Although  such  games  prove  little  in  a  narrow  scientific  sense,  the 
motivation  for  gaming  is  to  encourage  creative,  innovative  think¬ 
ing  about  problems  that  resist  analysis  with  more  conventional 
approaches  and  methods.  Given  our  tendency  to  ascribe  similar 
thought  processes  to  others  whether  probable  or  not  (Witlin  2008), 
the  use  of  Engle  matrix  games  to  investigate  possible  reactions  is  a 
valuable  and  often  neglected  technique.  T  he  role-playing  nature  of 
Engle  matrix  games  provides  insights  into  the  special  problems  of 
command  and  control,  which  despite  itsorigins  is  not  only  a  military 
term.  Engle  matrix  games  are  important  educational  experiences, 
providing  participants  an  opportunity  to  become  aware  of  facts 
associated  with  possible  conflicts  Positions,  expectations,  percep¬ 
tions,  facts,  and  procedures  typically  are  challenged  and  improved 
as  the  game  proceeds.  For  these  reasons  it  is  suggested  that  the  E  ngle 
matrix  game  technique  may  be  usefully  applied  to  interagency  coor¬ 
dination  issues. 

T  here  are  undoubtedly  areas  where  games  and  simulations  are  dif¬ 
ficult  to  apply.  T  hereare  strong  beliefs  that  wargames  at  the  strategic 
level  cannot  capture  realistic  applications  of  diplomatic,  informa¬ 
tional,  military,  and  economic  effects,  as  there  are  too  many  influ¬ 
ences  that  bear  on  strategic  situations  that  cannot  be  replicated. 
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Indeed,  a  single  game  could  not  consider  all  the  issues,  complexities, 
and  nuances  that  are  present  in  complex  situations.  For  this  purpose, 
a  series  of  games  may  be  needed. 

In  her  article,  M  cCown  (2005,  38)  writes  that  games  are  "designed 
to  enhance  understanding  of  crisis  decision  making  in  an  inter¬ 
agency  setting,  the  forums  allow  exploration  of  emerging  national 
security  issues  and  the  capabilities  and  limitations  of  instruments  of 
national  power  in  dealing  with  these  challenges."  She  describes  an 
interagency  rehearsal  as  a  mechanism  for  coordinating  activity  con¬ 
ducted  near  the  end  of  the  political-military  planning  process  Such 
interagency  rehearsals  will  almost  always  result  in  the  modification 
of  plans.  In  the  US  National  Strategic  Gaming  Center,  National 
Defense  U  niversity,  the  rehearsal  is  part  of  the  integrated  planning 
process,  not  the  final  presentation  of  a  completed  plan.  Rehearsals 
are  held  to  help  discover  and  resolve  potential  problems  a  plan  could 
encounter  before  they  become  actual  problems  on  the  ground. 

This  article  has  discussed  a  particular  approach  to  wargaming, 
Engle  matrix  games,  establishing  its  utility  and  outlining  a  proposed 
set  of  practices  useful  for  constructing  and  executing  such  games. 
The  practice  provides  a  vehicle  to  include  important  socio-politi¬ 
cal  elements  in  wargaming  and  create  a  role-play  environment  that 
provides  better  predictive  capacity  than  individual  expert  judg¬ 
ment.  Engle  matrix  games  are  capable  of  making  implicit  knowl¬ 
edge  explicit,  both  through  verbalization  and  via  auditable,  recorded 
data.  Because  of  this,  we  propose  greater  use  of  Engle  matrix  games 
and  suggest  that  this  technique  can  be  successfully  applied  to  inter¬ 
agency  issues.  T  hey  can  sharpen  our  questions  and  for  this  reason 
we  do  not  advocate  Engle  matrix  games  for  their  predictive  worth, 
we  see  their  value  as  greatest  when  used  as  an  educational  tool  to 
broaden  one's  repertoire  of  responses. 


T  he  authors  would  like  to  acknowledge  the  assistance  of  Dr.  J  eremy  M  anton  and 
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